Social recommendation method based on multi-feature heterogeneous graph neural networks

ABSTRACT

A social recommendation method based on a multi-feature heterogeneous graph neural network is provided and includes: extracting attribute information of users and topics to code; processing user coding information and topic coding information through a multi-layer perceptron to obtain initial feature vectors of the users and the topics; establishing a heterogeneous graph by taking the users and the topics as nodes; inputting the heterogeneous graph into a heterogeneous graph neural network to perform information transmission in combination with an attention mechanism, and updating the feature vectors; and performing similarity calculation on the feature vectors of the users, and selecting the user and the topic with the highest similarity with the feature vector of the user for recommendation. Social information can be mined more comprehensively, features of users and interested topics of the users can be deeply fused, and recommendation accuracy and user experience can be improved.

TECHNICAL FIELD

The disclosure relates to the field of data mining and informationrecommendation technologies, particular to a social recommendationmethod based on a multi-feature heterogeneous graph neural network.

BACKGROUND

In recent years, with rapid development of internet informationtechnologies and ancillary industries thereof, internet services andtransactions have become more and more popular, and people are more andmore inclined to use the internet for social activities. Due to a largenumber of users, social networks generate a large amount of userbehavior information every day, such as mutual attention, comments,likes and exchanges on topics of common interest, resulting ininformation overload, which provides users with rich information, butinevitably makes the users spend a lot of time on a large number ofinformation that they are not interested in. Therefore, the informationoverload is both a challenge and an opportunity for users and socialplatforms. The emergence of a recommendation system provides a solutionfor mining information of interest to users from a large amount of datainformation, which can save users' time, improve user experience,increase the stickiness of the platform to the user, and improve usersatisfaction and platform revenue. Therefore, using an effectiverecommendation system technology to extract information of interest froma large number of user interaction information and recommend it to theuser is of great value to the user and social networking platforms, andthereby the social recommendation system has become a hot researchdirection.

In the existing social recommendation system technologies, most of themonly consider a part of the sparse information (such as users'attention, comments, likes and other interactive behaviors), and do notconsider the impact of the joint action of multiple factors on therecommendation system, which will lead to insufficient informationmining on social networks. In addition, most of the current technologiesonly focus on user interaction or topics of interest to users, whichwill also lead to the loss of information and have certain limitations.

SUMMARY

In order to overcome defects and shortcomings of the existingtechnology, the disclosure provides a social recommendation method basedon a multi-feature heterogeneous graph neural network, which extracts avariety of features of users and topics, establishes a heterogeneousgraph for the users and the topics at the same time, comprehensivelymines interactive information of a social network, and deeply integratesthe features of the users and their interest topics, so as to obtain amore accurate social recommendation effect and improve the userexperience.

In order to achieve the above purpose, the disclosure provides thefollowing solutions.

A social recommendation method based on a multi-feature heterogeneousgraph neural network, includes:

extracting attribute information of users and attribute information oftopics at the same time, and coding the attribute information of theusers and the attribute information of the topics to obtainmulti-feature codes of the users and multi-feature codes of the topics;

inputting the multi-feature codes of the users and the multi-featurecodes of the topics into different multi-layer perceptron to train atthe same time, and outputting initial feature vectors of the users andinitial feature vectors of the topics;

taking the users and the topics on a social network as nodes, performinga user-user edge linking based on network social interactions of theusers, performing a user-topic edge linking based on the topics ofinterest to the users, performing normalization on weights of user-useredges after calculating the weights of the user-user edges, andperforming normalization on weights of user-topic edges aftercalculating the weights of the user-topic edges; and outputting aheterogeneity graph;

building a heterogeneous graph neural network model;

inputting the heterogeneous graph into the heterogeneous graph neuralnetwork model, and calculating attention scores of user type neighbornodes and attention scores of topic type neighbor nodes by usingdifferent attention vectors respectively;

performing normalization on the attention scores of the user typeneighbor nodes and the attention scores of the topic type neighbor nodesrespectively and then performing normalization together to obtainattention scores of a neighbor node set of a central node;

performing feature transfer on each of neighbor nodes of the neighbornode set of the central node based on the attention score of each of theneighbor nodes of the neighbor node set and then performing informationaggregation together with features of the central node to update afeature representation of the central node, and outputting updatedvector representations of the users and the topics after the informationaggregation through the heterogeneous graph neural network;

calculating feature vector similarity between a recommended target userand each of the users, and feature vector similarity between the targetuser and each of the topics, selecting one of the users with a highestsimilarity and one of the topics with a highest similarity after sortingthe feature vector similarity to recommend to the target user.

In an embodiment, the coding the attribute information of the users andthe attribute information of the topics includes:

coding semantic information related to natural language by using aword2vec method, including: noise information removal, word segmentationand stop word processing, training word representations of numericalvectorization and obtaining embedding coding representations of thesemantic information; and performing one-hot coding on data representedby discrete values.

In an embodiment, a calculation formula for each layer of themulti-layer perceptron is that:

H ^((l))=ø(W ^((l)) ·H ^((l−1)) +b ^((l));

where H^((l)) represents an output vector of a lth layer; W^((l))represents a trainable weight matrix of the lth layer; b^((l))represents a bias vector of the lth layer; H^((l−1)) represents anoutput vector of a (l−1)th layer, and when l=1, H^((l−1)) represents themulti-feature codes of the users and the multi-feature codes of thetopics; and ø represents an activate function.

In an embodiment, the performing a user-user edge linking based onnetwork social interactions of the users, includes:

when two of the users have carried out the network social interactions,performing the user-user edge linking on the two of the users; thenetwork social interactions including at least one of interactions ofattentions, likes and comments; and

the weight of the user-user edge between the two of the users beinginitialized to a number of times of the network social interactionsbetween the two of the users.

In an embodiment, the performing a user-topic edge linking based on thetopics of interest to the users, includes:

when one of the users has paid attention to and commented on one of thetopics, performing the user-topic edge linking on the one of the usersand the one of the topics; and the weight of the user-topic edge betweenthe one of the users and the one of the topics being initialized to anumber of times that the one of the users pays attention to and commenton the one of the topics.

In an embodiment, the calculating attention scores of user type neighbornodes and attention scores of topic type neighbor nodes by usingdifferent attention vectors respectively through calculation formulas asfollows:

a _(vv) _(user) =θ(μ_(u) ^(T)·[h _(v) ∥h _(v) _(user) ]),v _(user) ∈N_(v)and v _(user) represents one of the user type neighbor nodes;

a _(vv) _(topic) =θ(μ_(u) ^(T)·[h _(v) ∥h _(v) _(topic) ]),v _(topic) ∈N_(v)and v _(topic) represents one of the topic type neighbor nodes;

where v represents the central node of the information aggregation,N_(v) represents the neighbor node set of v, a_(vv) _(user) , representsthe attention score of one of the user type neighbor nodes, a_(vv)_(topic) represents the attention score of one of the topic typeneighbor nodes, μ_(u) ^(T) represents a transpose of a learnableattention weight vector of one of the user type neighbor nodes, μ_(t)^(T) represents a transpose of a learnable attention weight vector ofone of the topic type neighbor nodes, h_(v) represents a feature vectorof the central node, h_(v) _(user) represents a feature vector of one ofthe user type neighbor nodes, h_(v) _(topic) represents a feature vectorof one of the topic type neighbor nodes, a represents an activatefunction, v_(user) represents one of the user type neighbor nodes in theneighbor node set of v, and v_(topic) represents one of the topic typeneighbor nodes in the neighbor node set of v.

In an embodiment, the performing normalization on the attention scoresof the user type neighbor nodes and the attention scores of the topictype neighbor nodes respectively and then performing normalizationtogether to obtain attention scores of a neighbor node set of a centralnode through calculation formulas as follows:

${\theta_{{vv}_{user}} = \frac{\exp\left( a_{{vv}_{user}} \right)}{\sum_{i \in {N_{v}{and}i{represents}a{user}{node}}}{\exp\left( a_{vi} \right)}}},$

v_(user) ∈ N_(v) and v_(user) represents one of the user type neighbornodes;

${\theta_{{vv}_{topic}} = \frac{\exp\left( a_{{vv}_{topic}} \right)}{\sum_{j \in {N_{v}{and}j{represents}a{topic}{node}}}{\exp\left( a_{vj} \right)}}},$

v_(topic)∈ N_(v) and v_(topic) represents one of the topic type neighbornodes;

${\theta_{{vv}^{\prime}} = \frac{\exp\left( \theta_{{vv}^{\prime}} \right)}{\sum_{k \in N_{v}}{\exp\left( \theta_{vk} \right)}}},$

and v′ ∈ N_(v);

where θ represents the attention score after the normalization by asoftmax function, v represents the central node of the informationaggregation, N_(v) represents the neighbor node set of v, v′ representsa neighbor node of v, θ_(vv), represents a value of a vth row and v′thcolumn of an attention score matrix, a_(vv) _(user) represents theattention score of one of the user type neighbor nodes, a_(vv) _(topic)represents the attention score of one of the topic type neighbor nodes,θ_(vv) _(user) represents the attention score of a target user typeneighbor node after the normalization, θ_(topic) represents theattention score of a target topic type neighbor node after thenormalization, a_(vi), represents the attention score of one of the usertype neighbor nodes before the normalization, a_(vj) represents theattention score of one of the topic type neighbor nodes before thenormalization, k represents a node of the neighbor node set of v, irepresents the user type neighbor node of the neighbor node set of v, jrepresents the topic type neighbor node of the neighbor node set of v,and θ_(vk) represents the attention score of the neighbor node after thenormalization.

In an embodiment, the performing feature transfer on each of neighbornodes of the neighbor node set of the central node based on theattention score of each of the neighbor nodes of the neighbor node setand then performing information aggregation together with features ofthe central node to update a feature representation of the central nodethrough a calculation formula as follows:

h _(i) ^((l+1))=θ(Σ_(j ∈N(i))θ_(ij) ·h ^((l)) ·W ^((l));

where h_(i) ^((l+1)) represents a feature vector of the central node iin a node feature matrix of a (i+1)th layer of the heterogeneous graphneural network, h^((l)) represents a node feature matrix obtained by aith layer of the heterogeneous graph neural network, W^((l)) representsa trainable weight matrix of the ith layer of the heterogeneous graphneural network, θ_(ij) represents the attention score of the centralnode i and a neighbor node j, θ a represents an activate function, and N(i) represents the neighbor node set of the central node i.

In an embodiment, the heterogeneous graph neural network model isjointly trained with the multi-layer perceptron to share a backpropagation loss in a training process and update parameters at the sametime; and

wherein feature vectors of each of user nodes and each of topic nodesafter the feature transfer and the information aggregation through amulti-layer heterogeneous graph neural network are updated into a userand topic database.

The disclosure further provides a social recommendation system based ona multi-feature heterogeneous graph neural network, including: aninformation extracting module, a coding module, an initial featurevector outputting module, a heterogeneity graph building module, aheterogeneous graph neural network model building module, an attentionscore calculating module, an attention score synthesis calculatingmodule, an information aggregation and updating module, a feature vectorsimilarity calculating module, and a recommend result outputting module;

the information extracting module is configured to extract attributeinformation of users and attribute information of topics;

the coding module is configured to code the attribute information of theusers and the attribute information of the topics;

the initial feature vector outputting module is configured to outputinitial feature vectors, input multi-feature codes of the users andmulti-feature codes of the topics after the coding into differentmulti-layer perceptron to train, and output initial feature vectors ofthe users and initial feature vectors of the topics;

the heterogeneity graph building module is configured to building aheterogeneity graph by taking the users and the topics on a socialnetwork as nodes, performing a user-user edge linking based on networksocial interactions of the users, performing a user-topic edge linkingbased on the topics of interest to the users, performing normalizationon weights of user-user edges after calculating the weights of theuser-user edges, and performing normalization on weights of user-topicedges after calculating the weights of the user-topic edges, and outputthe heterogeneity graph;

the heterogeneous graph neural network model building module isconfigured to build a heterogeneous graph neural network model;

the attention score calculating module is configured to input theheterogeneous graph into the heterogeneous graph neural network model,and calculate attention scores of user type neighbor nodes and attentionscores of topic type neighbor nodes by using different attention vectorsrespectively;

the attention score synthesis calculating module is configured toperform normalization on the attention scores of the user type neighbornodes and the attention scores of the topic type neighbor nodesrespectively and then perform normalization together to obtain attentionscores of a neighbor node set of a central node;

the information aggregation and updating module is configured to performfeature transfer on each of neighbor nodes of the neighbor node set ofthe central node based on the attention score of each of the neighbornodes of the neighbor node set and then perform information aggregationtogether with features of the central node to update a featurerepresentation of the central node, and output updated vectorrepresentations of the users and the topics after the informationaggregation through the heterogeneous graph neural network;

the feature vector similarity calculating module is configured tocalculate feature vector similarity between a recommended target userand each of the users, and feature vector similarity between the targetuser and each of the topics; and

the recommend result outputting module is configured to output recommendresults of one of the users with a highest similarity and one of thetopics with a highest similarity after sorting the feature vectorsimilarity.

Compared with the prior art, the disclosure has the following advantagesand beneficial effects:

(1) The disclosure pays attention to behavior features of the users inthe social network, and considers the influence of the joint action ofthe multiple factors and features of users and topics in the socialnetwork on the recommendation system, so as to more comprehensively minethe social network information of users.

(2) The disclosure takes the users and the topics as nodes to establishthe heterogeneous graph at the same time, carries out informationtransmission and aggregation through the heterogeneous graph neuralnetwork, fits the real structure of the real social network, paysattention to user interaction and topics of interest to users, deeplyintegrates the features of users and their topics of interest, andimproves the accuracy of recommendation and user experience.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a schematic flowchart of a social recommendationmethod based on a multi-feature heterogeneous graph neural network ofthe disclosure.

FIG. 2 illustrates a schematic operation diagram of initializing featurevectors by the multi-layer perceptron of the disclosure.

FIG. 3 illustrates a schematic diagram of establishing a heterogeneousgraph by taking users and topics as nodes in the disclosure.

FIG. 4 illustrates a schematic operation diagram of a heterogeneousgraph neural network of the disclosure.

DETAILED DESCRIPTION OF THE EMBODIMENTS

In order to make objects, technical schemes and advantages of thedisclosure more clear, the disclosure is further described in detailbelow in combination with the accompanying drawings and embodiments. Itshould be understood that the specific embodiments described herein areonly used to explain the disclosure and are not used to define thedisclosure.

Embodiment 1

As illustrated in FIG. 1 , the embodiment of the disclosure provides asocial recommendation method based on a multi-feature heterogeneousgraph neural network, including the step S1 to the step S4.

At the step S1, extracting and processing attribute information of usersand topics.

The attribute information (such as nickname, age, city, etc.) of theusers and the attribute information (such as theme, heat (also referredto as popularity), profile, etc.) of the topics are extracted at thesame time, which involves semantic information of natural language, aword to vector (word2vec) method is used to code the semanticinformation to obtain embedding feature codes, and the other datarepresented by discrete values can be one-hot coded.

The extracting and processing the attribute information of the users andthe topics in the embodiment can include step S1.1 to step S1.3.

At the step S1.1, multi-feature extraction.

The attribute information (such as nickname, age, city, etc.) of theusers of a social platform and the attribute information (such as theme,heat, profile, etc.) of the topics are preliminarily extracted at thesame time.

At the step S1.2, embedding feature coding.

For the extracted attribute information, if the extracted attributeinformation involves the semantic information (such as user nickname,topic profile, etc.) of the natural language, a natural languageprocessing method is used to obtain the feature codes. The specificsteps are as follows: first, processing the semantic data, includingnoise information removal, word segmentation and stop word processing,training word representations of numerical vectorization and obtainingembedding coding representations of the semantic information.

The noise information removal includes: processing the semanticinformation through a regular expression to filter irrelevant noiseinformation, such as URLs, garbled characters, etc.

The word segmentation and stop word processing includes: for thesemantic information after the noise information is removed, a wordsegmentation tool is used to segment words, and a text sequence isconverted into a corresponding word list after the word segmentation;for the corresponding word list after the word segmentation, stop wordsare processed through a stop word list to obtain a word list after thestop words are removed.

The training word representations of numerical vectorization, includes:according to a word group obtained by the word segmentation according tothe semantic information, an initial word embedding vector of the wordlist corresponding to the semantic information is trained by using theword2vec neural network feature embedding method, and then the wordembedding vector fused with the word position information is obtained byadding the position vector representing the word position to each wordvector.

The obtaining embedding coding representations of the semanticinformation, includes: performing a mean-pooling on the word vectors ofeach word contained in the semantic information, and obtaining theembedding coding representation of the semantic information.

At the step S1.3, one-hot feature coding.

For the extracted attribute information, one-hot coding is performed onthe data (such as age, city, etc.) that can be represented by discretevalues. For example, if the age of the user group on the social networkis 20-24 years old, for a 21-year-old user, the one-hot feature codingof the age is represented by [0,1,0,0,0].

At the step S2, obtaining initial feature vectors (also referred to aseigenvectors) of the users and initial feature vectors of the topics.

As illustrated in FIG. 2 , a multi-layer perceptron initializes featurevectors, the multi-feature codes of the users and the multi-featurecodes of the topics are respectively inputted into a multi-layerperceptron used to train user feature vectors and a multi-layerperceptron used to train topic feature vectors at the same time, andoutputs the initial feature vectors of the users and the initial featurevectors of the topics, the initial feature vectors of the users and theinitial feature vectors of the topics are as node feature vectors of theuser nodes and node feature vectors of the topic nodes in theheterogeneous graph neural network.

A calculation formula for each layer of the multi-layer perceptron isthat:

H ^((l))=ø(W ^((l)) ·H ^((l−1)) +b ^((l))).

Where H^((l)) represents an output vector of the lth layer, W^((l))represents a trainable weight matrix of the lth layer, b^((l))represents a bias vector of the lth layer, H^(l−1) represents an outputvector of an upper layer of the lth later, when a current layer is afirst layer, i.e., l=1 H^((l−1)) represents the multi-feature codes ofthe users and the multi-feature codes of the topics, ø represents anactivate function, and is selected from one of Relu function and softmaxfunction.

At the step S3, building a heterogeneous graph for the users and thetopics.

As illustrated in FIG. 3 , considering the behavior features of theusers in social networks, the users and the topics are used as nodes toestablish the heterogeneous graph, and the users and the topics insocial networks are used as nodes at the same time to establish theheterogeneous graph through user-user edge linking and user-topic edgelinking. The condition of the user-user edge linking includes: when twousers have interacted with each other including at least one ofattentions, likes and comments, the edge linking is performed. Theweight of the user-user edge is initialized to the number of times ofattentions, likes and comments between the two users. After calculatingthe weights of all the user-user edges, the weight of each user-useredge is normalized. The condition of the user-topic edge linkingincludes: when the user has paid attention to and commented on thetopic, the edge linking is performed. The weight of the user-topic edgeis initialized to the number of times that the user pays attention toand comments on the topic. After calculating the weights of all theuser-topic edges, the weight of each user-topic edge is normalized, theuser-topic heterogeneity graph is obtained. This method fits the realstructure of the real social network, pays attention to the mostimportant user interaction and topics of interest to users in the socialnetwork, and pays attention to the fine-grained edge connection methodof user specific operations, and considers user behavior characteristicsmore comprehensively and carefully, which helps to deeply integrate thefeatures of users and their topics of interest in subsequent models.

MM max normalization is adopted for the normalization, and a calculationformula is that:

$v_{normal} = {\frac{v - v_{\min}}{v_{\max} - v_{\min}}.}$

Where v represents an edge weight before the normalization, v_(min),represents a minimum value of all edge weights before the normalization,v_(max) represents a maximum value of all edge weights before thenormalization, and v_(normal) represents an edge weight after thenormalization.

The user-user type edge weights and the user-topic type edge weights arenormalized respectively. Compared with normalized together with the twotypes of edge weights, the disclosure helps to mitigate the differencesbetween different types of edge weights, maintain the unique informationof different types of edge weights, and better unify the operation ofthe following two types of edge weights.

At the step S4, building a heterogeneous graph neural network model.

As illustrated in FIG. 4 , the user-topic heterogeneous graph isinputted into the heterogeneous graph neural network model, for the usertype neighbor nodes and the topic type neighbor nodes, differentattention vectors are used to calculate the attention scores through theattention mechanism, the two types of the attention scores (i.e., theattention score of the user type neighbor node and the attention scoreof the topic type neighbor node) are normalized separately and thennormalized together, combining the attention score of each node in thetwo types, the information transfer and aggregation of the neighbornodes are performed, and the updated vector representation of each userand topic after the information aggregation through the heterogeneousgraph neural network is output.

At the step S4, the building the heterogeneous graph neural networkmodel, includes the step S4.1 to step S4.3.

At the step S4.1, calculating attention scores of user type neighbornodes and attention scores of topic type neighbor nodes.

For a central node of the information aggregation, its neighbor nodesmay be user type nodes or topic type nodes. For two different types ofneighbor nodes, their attention scores are calculated by their ownattention mechanisms. The calculation formulas are as follows:

a _(vv) _(user) =θ(μ_(u) ^(T)·[h _(v) ∥h _(v) _(user) ]),v _(user) ∈N_(v)and represents the user type neighbor node;

a _(vv) _(topic) =θ(μ_(u) ^(T)·[h _(v) ∥h _(v) _(user) ]),v _(user) ∈N_(v)and represents the topic type neighbor node.

Where v represents the central node of the information aggregation,N_(v) represents the neighbor node set of v, a_(vv) _(user) representsthe attention score of the user type neighbor node, a_(vv) _(topic)represents the attention score of the topic type neighbor node, μ_(u)^(T) represents a transpose of a learnable attention weight vector ofthe user type neighbor node, μ_(u) ^(T) represents a transpose of alearnable attention weight vector of the topic type neighbor node, h_(v)represents a feature vector of the central node, h_(v) _(user)represents a feature vector of the user type neighbor node, h_(v)_(topic) represents a feature vector of the topic type neighbor node, arepresents an activate function, v_(user) represents the user typeneighbor node in the neighbor node set, and v_(topic) represents thetopic type neighbor node in the neighbor node set of v.

At the step S4.2, synthesizing the attention scores.

The attention scores of the user type neighbor nodes and the topic typeneighbor nodes are normalized respectively to obtain the normalizedattention scores of their respective types, and then the attentionscores of the neighbor node set of the central node are obtained througha softmax normalization synthesis to better maintain the distribution ofattention scores of various types. The calculation formulas are asfollows:

${\theta_{{vv}_{user}} = \frac{\exp\left( a_{{vv}_{user}} \right)}{\sum_{i \in {N_{v}{and}i{represents}a{user}{node}}}{\exp\left( a_{vi} \right)}}},$

v_(user) ∈ N_(v) and v_(user) represents one of the user type neighbornodes;

${\theta_{{vv}_{topic}} = \frac{\exp\left( a_{{vv}_{topic}} \right)}{\sum_{j \in {N_{v}{and}j{represents}a{topic}{node}}}{\exp\left( a_{vj} \right)}}},$

v_(topic) ∈ N_(v), and v_(topic) represents one of the topic typeneighbor nodes;

${\theta_{{vv}^{\prime}} = \frac{\exp\left( \theta_{{vv}^{\prime}} \right)}{\sum_{k \in N_{v}}{\exp\left( \theta_{vk} \right)}}},$

and v′ ∈ N_(v);

where θ represents the attention score after the normalization by asoftmax function, θ_(vv), represents a value of a with row and v′thcolumn of an attention score matrix, v′ represents the neighbor node ofv, N_(v) represents the neighbor node set of v, a_(vv) _(user)represents the attention score of the user type neighbor node, a_(vv)_(topic) represents the attention score of the topic type neighbor node,θ_(vv) _(user) represents the attention score of a target user typeneighbor node after the normalization, θ_(vv) _(topic) represents theattention score of a target topic type neighbor node after thenormalization, a_(vi) represents the attention score of the user typeneighbor node before the normalization, a_(vj) represents the attentionscore of the topic type neighbor node before the normalization, krepresents a node of the neighbor node set of v, i represents the usertype neighbor node of the neighbor node set of v, j represents the topictype neighbor node of the neighbor node set of v, and θ_(vk) representsthe attention score of the neighbor node after the normalization.

At the step S4.3, information aggregation and updating.

Performing feature transfer on each neighbor node of the central nodeaccording to its attention score and aggregates with the features of thecentral node to update the feature representation of the central node,and a calculation formula is as follows:

h _(i) ^((l+1))=θ(Σ_(j∈N(i))θ_(ij) ·h ^((l)) ·W ^((l))).

Where h_(i) ^((l+1)) represents a feature vector of the central node iin a node feature matrix of a (i+1)th layer of the heterogeneous graphneural network, h^((l))represents a node feature matrix obtained by aith layer of the heterogeneous graph neural network, when l=0, h⁽⁰⁾represents a matrix composed of node initial feature vectors, W^((l))represents a trainable weight matrix of the ith layer of theheterogeneous graph neural network, θ_(ij) represents the attentionscore of the central node i and its neighbor node j, θ represents anactivate function, and N(i) represents the neighbor node set of thecentral node i.

In the training process, the heterogeneous graph neural network model isjointly trained with the previous multilayer perceptron model, that is,the heterogeneous graph neural network model and the previous multilayerperceptron model share the back propagation loss in the trainingprocess, and update the parameters of the model at the same time.

The feature vector of each user node and the feature vector of eachtopic node after the information transmission and aggregation throughthe 1 layers of the heterogeneous graph neural network are updated intoa user and topic database.

At the step S5, user and topic recommendation of the top□k vectorsimilarity.

For the target user to be recommended, the feature vector similaritybetween the target user and each user and the feature vector similaritybetween the target user and each topic are calculated. After sorting allthe feature vector similarity, the top-k user and topic with the highestsimilarity are selected to recommend to the target user.

The calculation formula of the similarity is as follows:

${similarity}_{i,j} = {\frac{F_{i} \cdot F_{j}}{{F_{i}} \times {F_{j}}} = {\frac{\sum_{k = i}^{n}{\left( F_{i} \right)_{k} \times \left( F_{j} \right)_{k}}}{\sqrt{\sum_{k = 1}^{n}\left( F_{i} \right)_{k}^{2}} \times \sqrt{\sum_{k = 1}^{n}\left( F_{j} \right)_{k}^{2}}}.}}$

Where F_(i) represents a feature vector of the user i, F_(j) representsa feature vector of the topic j, similarity_(i,j) represents a vectorsimilarity between the user i and the user j or the topic j, sorting thecalculated vector similarity, and selecting the top Ok user and topicwith the highest vector similarity for recommendation.

Embodiment 2

This embodiment provides a social recommendation system based on amulti-feature heterogeneous graph neural network, including: aninformation extracting module, a coding module, an initial featurevector outputting module, a heterogeneity graph building module, aheterogeneous graph neural network model building module, an attentionscore calculating module, an attention score synthesis calculatingmodule, an information aggregation and updating module, a feature vectorsimilarity calculating module, and a recommend result outputting module.

In this embodiment, the information extracting module is configured tosimultaneously extract attribute information of users and attributeinformation of topics.

In this embodiment, the coding module is configured to code theattribute information of the users and the attribute information of thetopics.

In this embodiment, the initial feature vector outputting module isconfigured to output initial feature vectors, input multi-feature codesof the users and multi-feature codes of the topics after the coding intodifferent multi-layer perceptron to train, and output initial featurevectors of the users and initial feature vectors of the topics.

In this embodiment, the heterogeneity graph building module isconfigured to building a heterogeneity graph by taking the users and thetopics on a social network as nodes, performing a user-user edge linkingbased on network social interactions of the users, performing auser-topic edge linking based on the topics of interest to the users,performing normalization on weights of user-user edges after calculatingthe weights of the user-user edges, and performing normalization onweights of user-topic edges after calculating the weights of theuser-topic edges, and output the heterogeneity graph.

In this embodiment, the heterogeneous graph neural network modelbuilding module is configured to build a heterogeneous graph neuralnetwork model.

In this embodiment, the attention score calculating module is configuredto input the heterogeneous graph into the heterogeneous graph neuralnetwork model, and calculate attention scores of user type neighbornodes and attention scores of topic type neighbor nodes by usingdifferent attention vectors respectively.

In this embodiment, the attention score synthesis calculating module isconfigured to perform normalization on the attention scores of the usertype neighbor nodes and the attention scores of the topic type neighbornodes respectively and then perform normalization together to obtainattention scores of a neighbor node set of a central node.

In this embodiment, the information aggregation and updating module isconfigured to perform feature transfer on each of neighbor nodes of theneighbor node set of the central node based on the attention score ofeach of the neighbor nodes of the neighbor node set and then performinformation aggregation together with features of the central node toupdate a feature representation of the central node, and output updatedvector representations of the users and the topics after the informationaggregation through the heterogeneous graph neural network.

In this embodiment, the feature vector similarity calculating module isconfigured to calculate feature vector similarity between a recommendedtarget user and each of the users, and feature vector similarity betweenthe target user and each of the topics.

In this embodiment, the recommend result outputting module is configuredto output recommend results of the top-k user with a highest similarityand the top-k topic with a highest similarity after sorting the featurevector similarity.

The above embodiments are the preferred embodiments of the disclosure,but the embodiments of the disclosure are not limited by the aboveembodiments. Any other changes, amendments, replacements, combinations,and simplifications made without departing from the spiritual essenceand principles of the disclosure shall be equivalent replacementmethods, which are included in the protection scope of the disclosure.

What is claimed is:
 1. A social recommendation method based on amulti-feature heterogeneous graph neural network, comprising: extractingattribute information of users and attribute information of topics, andcoding the attribute information of the users and the attributeinformation of the topics to obtain multi-feature codes of the users andmulti-feature codes of the topics; inputting the multi-feature codes ofthe users and the multi-feature codes of the topics into differentmulti-layer perceptron to train, and outputting initial feature vectorsof the users and initial feature vectors of the topics; building aheterogeneity graph by taking the users and the topics on a socialnetwork as nodes, performing a user-user edge linking based on networksocial interactions of the users, performing a user-topic edge linkingbased on the topics of interest to the users, performing normalizationon weights of user-user edges after calculating the weights of theuser-user edges, and performing normalization on weights of user-topicedges after calculating the weights of the user-topic edges; andoutputting the heterogeneity graph; building a heterogeneous graphneural network model; inputting the heterogeneous graph into theheterogeneous graph neural network model, and calculating attentionscores of user type neighbor nodes and attention scores of topic typeneighbor nodes by using different attention vectors respectively;performing normalization on the attention scores of the user typeneighbor nodes and the attention scores of the topic type neighbor nodesrespectively and then performing normalization together to obtainattention scores of a neighbor node set of a central node; performingfeature transfer on each of neighbor nodes of the neighbor node set ofthe central node based on the attention score of each of the neighbornodes of the neighbor node set and then performing informationaggregation together with features of the central node to update afeature representation of the central node, and outputting updatedvector representations of the users and the topics after the informationaggregation through the heterogeneous graph neural network; andcalculating feature vector similarity between a recommended target userand each of the users, and feature vector similarity between the targetuser and each of the topics, selecting one of the users with a highestsimilarity and one of the topics with a highest similarity after sortingthe feature vector similarity to recommend to the target user.
 2. Thesocial recommendation method based on the multi-feature heterogeneousgraph neural network according to claim 1, wherein the coding theattribute information of the users and the attribute information of thetopics, comprises: coding semantic information related to naturallanguage by using a word2vec method, comprising: noise informationremoval, word segmentation and stop word processing, training wordrepresentations of numerical vectorization and obtaining embeddingcoding representations of the semantic information; and performingone-hot coding on data represented by discrete values.
 3. The socialrecommendation method based on the multi-feature heterogeneous graphneural network according to claim 1, wherein a calculation formula foreach layer of the multi-layer perceptron is that:H ^((l))=ø(W ^((l)) ·H ^((l−1)) +b ^((l)); where H^((l)) represents anoutput vector of a lth layer; W^((l)) represents a trainable weightmatrix of the lth layer; b^((l)) represents a bias vector of the lthlayer; H^((l−1)) represents an output vector of a (l−1)th layer, andwhen l=1, H^((l−1)) represents the multi-feature codes of the users andthe multi-feature codes of the topics; and ø represents an activatefunction.
 4. The social recommendation method based on the multi-featureheterogeneous graph neural network according to claim 1, wherein theperforming a user-user edge linking based on network social interactionsof the users, comprises: when two of the users have carried out thenetwork social interactions, performing the user-user edge linking onthe two of the users; wherein the network social interactions compriseat least one of interactions of attentions, likes and comments; andwherein the weight of the user-user edge between the two of the users isinitialized to a number of times of the network social interactionsbetween the two of the users.
 5. The social recommendation method basedon the multi-feature heterogeneous graph neural network according toclaim 1, wherein the performing a user-topic edge linking based on thetopics of interest to the users, comprises: when one of the users haspaid attention to and commented on one of the topics, performing theuser-topic edge linking on the one of the users and the one of thetopics; wherein the weight of the user-topic edge between the one of theusers and the one of the topics is initialized to a number of times thatthe one of the users pays attention to and comments on the one of thetopics.
 6. The social recommendation method based on the multi-featureheterogeneous graph neural network according to claim 1, wherein thecalculating attention scores of user type neighbor nodes and attentionscores of topic type neighbor nodes by using different attention vectorsrespectively through calculation formulas as follows:a _(vv) _(user) =θ(μ_(u) ^(T)·[h _(v) ∥h _(v) _(user) ]),v _(user) ∈N_(v)and v _(user) represents one of the user type neighbor nodes;a _(vv) _(topic) =θ(μ_(u) ^(T)·[h _(v) ∥h _(v) _(user) ]),v _(user) ∈N_(v)and v _(topic) represents one of the user type neighbor nodes; wherev represents the central node of the information aggregation, N_(v)represents the neighbor node set of v, a_(vv) _(user) represents theattention score of one of the user type neighbor nodes, a_(vv) _(topic)represents the attention score of one of the topic type neighbor nodes,μ_(u) ^(T) represents a transpose of a learnable attention weight vectorof one of the user type neighbor nodes, μ_(u) ^(T) represents atranspose of a learnable attention weight vector of one of the topictype neighbor nodes, h_(v) represents a feature vector of the centralnode, h_(v) _(user) represents a feature vector of one of the user typeneighbor nodes, h_(v) _(topic) represents a feature vector of one of thetopic type neighbor nodes, θ represents an activate function, v_(user)represents one of the user type neighbor nodes in the neighbor node setof v, and v_(topic) represents one of the topic type neighbor nodes inthe neighbor node set of v.
 7. The social recommendation method based onthe multi-feature heterogeneous graph neural network according to claim1, wherein the performing normalization on the attention scores of theuser type neighbor nodes and the attention scores of the topic typeneighbor nodes respectively and then performing normalization togetherto obtain attention scores of a neighbor node set of a central nodethrough calculation formulas as follows:${\theta_{{vv}_{user}} = \frac{\exp\left( a_{{vv}_{user}} \right)}{\sum_{i \in {N_{v}{and}i{represents}a{user}{node}}}{\exp\left( a_{vi} \right)}}},$v_(user) ∈ N_(v), and v_(user) represents one of the user type neighbornodes;${\theta_{{vv}_{topic}} = \frac{\exp\left( a_{{vv}_{topic}} \right)}{\sum_{j \in {N_{v}{and}j{represents}a{topic}{node}}}{\exp\left( a_{vj} \right)}}},$v_(topic) ∈ N_(v), and v_(topic) represents one of the topic typeneighbor nodes;${\theta_{{vv}^{\prime}} = \frac{\exp\left( \theta_{{vv}^{\prime}} \right)}{\sum_{k \in N_{v}}{\exp\left( \theta_{vk} \right)}}},$and v′ ∈ N_(v); where θ represents the attention score after thenormalization by a softmax function, v represents the central node ofthe information aggregation, N_(v) represents the neighbor node set ofv, v′ represents a neighbor node of v, θ_(vv), represents a value of avth row and v′th column of an attention score matrix, a_(vv) _(user)represents the attention score of one of the user type neighbor nodes,a_(vv) _(topic) represents the attention score of one of the topic typeneighbor nodes, θ_(vv) _(user) represents the attention score of atarget user type neighbor node after the normalization, θ_(vv) _(topic)represents the attention score of a target topic type neighbor nodeafter the normalization, a_(vi) represents the attention score of one ofthe user type neighbor nodes before the normalization, a_(vj) representsthe attention score of one of the topic type neighbor nodes before thenormalization, k represents a node of the neighbor node set of v, irepresents the user type neighbor node of the neighbor node set of v, jrepresents the topic type neighbor node of the neighbor node set of v,and θ_(vk) represents the attention score of the neighbor node after thenormalization.
 8. The social recommendation method based on themulti-feature heterogeneous graph neural network according to claim 1,wherein the performing feature transfer on each of neighbor nodes of theneighbor node set of the central node based on the attention score ofeach of the neighbor nodes of the neighbor node set and then performinginformation aggregation together with features of the central node toupdate a feature representation of the central node through acalculation formula as follows:h _(i) ^((l+1))=θ(Σ_(j∈N(i))θ_(ij) ·h ^((l)) ·W ^((l))), where h_(i)^((l+1)) represents a feature vector of the central node i in a nodefeature matrix of a (i+1)th layer of the heterogeneous graph neuralnetwork, h^((l)) represents a node feature matrix obtained by a ithlayer of the heterogeneous graph neural network, W^((l)) represents atrainable weight matrix of the ith layer of the heterogeneous graphneural network, θ_(ij) represents the attention score of the centralnode i and a neighbor node j, θ represents an activate function, and N(i) represents the neighbor node set of the central node i.
 9. Thesocial recommendation method based on the multi-feature heterogeneousgraph neural network according to claim 1, wherein the heterogeneousgraph neural network model is jointly trained with the multi-layerperceptron to share a back propagation loss in a training process andupdate parameters at the same time; and wherein feature vectors of eachof user nodes and each of topic nodes after the feature transfer and theinformation aggregation through the heterogeneous graph neural networkwith multiple layers are updated into a user and topic database.